Chapter 14 


Recursive Methods 


14.1 Using Recursion 

Some problems in combinatorics and probability can be solved using recursive methods. Here 
is the basic idea: Suppose we are interested in computing a sequence a n , for n = 0,1, 2,... . The 
value a n could be the number of elements in a set or the probability of a certain event. We may 
be able to find a recursive relation that relates a n to other a^s where i < n. For example, 
suppose that for a certain problem, we can show that 

a n = a n - 1 + 2a n _ 3 , for n = 3,4, 5,... 

Now, if we know ao,ai, and < 22 , we can use the above recursive equation to find a n for all n. 
Let’s look at an example. 

Example 1. Find the total number of sequences of length n (using H and T) such that no two 
H s are next to each other. For example, for n = 2, we have 3 possible sequences: HT, TH , TT. 

Let a n be the number of such sequences. Let’s call these sequences “NO-HH sequences.” We 
have ai = 2 ,02 = 3. But how do we find, say aiooo? To do this, we will show that 

a n = a n ~ 1 + a n - 2 for n = 3,4, 5,... (14.1) 

To show this, consider a NO-HH sequence of length n. This sequence either starts with a T or 
an H. 


- If it starts with a T, then the rest of the sequence is simply a NO-HH sequence of length 
n— 1. Conversely, by adding a T in front of any NO-HH sequence of length n — 1, we can 
obtain a NO-HH sequence of length n. 

- If it starts with an H, then the second element in the sequence must be a T. In this 
case, the rest of the sequence is simply a NO-HH sequence of length n — 2. Conversely, 
by adding HT in front of any NO-HH sequence of length n — 2, we can obtain a NO-HH 
sequence of length n. 
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Thus, we conclude that a n = a n _i + a n _ 2 - Since we already know that ai = 2 and 02 = 3, we 
can use this recursive equation to find 

03 = 5, <24 = 8 , 05 = 13,... 

Using a computer program we can compute a n for the larger values of n. However, there is 
also a straight-forward method to solving Equation 14.1 in order to obtain a simple formula for 
a n that does not involve previous values in the sequence. We will discuss how to solve these 
equations in general shortly. Here, we solve Equation 14.1 to find a formula for the number of 
No-HH sequences of length n. The trick, as we will see, is to let a*, = x k and find non-zero 
values of x that satisfy the recursive equation. In particular, letting a & = x k in Equation 14.1, 
we obtain 


x 2 = x + 1 , 


which gives 


1 + V5 1-y/H 

xi = ^—,x 2 = ^^. 

Then the general solution can be written in the form of 

a n = aiXi + ot 2 X 2 , 

where aq and 02 are constants to be determined from the known values of a n . For example, 
here we know a\ = 2, <22 = 3. Using these two values we can find a\ and 0 . 2 - It is a little bit 
easier to use a 0 and oq. That is, since 02 = a\ + ag, we obtain a 0 = 1- Thus we have 


ao = 1 = Oq 
a\ = 2 = ai ( 


'l + v/5 N 


l + v/5 


+ «2 


+ « 2 


'l- V5 N 


1 - v/5 N 


Thus, we obtain 


{ oq + 012 — 1 

a,(ijV5)+ £«(!#) = 2 

By solving these equations, we obtain a\ = 5+ 1 3 n v/ ^ , and 012 = ■ Finally, 


a n — 


_ 5 + 3V5 fl + V5\ n 5 — 3\/5 f 1 — \/5 


10 l" 


10 V 


(14.2) 


This might seem somewhat strange as it does not look like an integer. However, you can evaluate 
the above expression for small values of n to see that, in fact, square roots always cancel out and 
the resulting values of a n are always integers. If the above calculation seems confusing, don’t 
worry. We will now discuss in general how to solve recursive equations such as the one given in 
Equation 14.1. 



14.1. USING RECURSION 


3 


14.1.1 Solving Linear Homogeneous Recurrence Equations with Constant 
Coefficients 

Suppose that we have the following recursive equation: 

Q-n + cia n _i + c 2 d n - 2 + c 3 a n _ 3 + ... + c d d n _ d = 0 (14.3) 

where the Cj’s are known constants. Also suppose that we already know the values of a* for 
d different values of i. For example, we might know the values of ai, a 2 ,..., ad- To solve this 
recursive equation, we first solve the following characteristic equation 

x d + cix d_1 + c 2 x d ~ 2 + c 3 x n ~ 3 + ... + c d = 0 (14.4) 

This equation is obtained by replacing a* by x l in the recursive Equation 14.3. Let x\, x 2 ,..., x d 
be d distinct roots of the characteristic polynomial (we will discuss the case of repeated roots 
shortly). Then the general format for solutions to the recursive Equation 14.3 is given by 

d n = ol lx™ + o 2 x 2 + oc 3 X 3 + ... + (14.5) 

The values of a 3 , a 2 ,..., a d can be obtained from the known values of a*. If a root is repeated r 
times, we need to include r terms for that root, each scaled by a power of n. For example, if x\ 
is a repeated root of multiplicity r, then we write 

Qn — flip] A ct\ 2 nx-^ 4 “ ot\ 3 ri x ^ 4~ ... 4~ x ^ 4~ 0 : 2 X 2 T 03 X 3 4~ ... 4~ ex d x d (14.6) 

To better understand all this, let’s look at some examples. 

Example 2. Solve the following recurrence equations: 

(a) a n = 3a n _i — 2a n - 2 , where a 0 = 2, a\ = 3; 

(b) a n = 4a n _i — 5a n - 2 + 2a n _ 3 , where a 0 = 0, ai = 2, and a 2 = 5. 

Solution 

(a) The characteristic polynomial for a n = 3a n _i — 2a n - 2 is x 2 — 3x 4- 2. It has roots x\ = 2 
and x 2 = 1. Thus, the general solution is of the form 

a n = a2 n 4~ (4. 

Since a 0 = 2, ai = 3, we obtain a = 1, /? = 1. Therefore, a n is given by 

a n = 2" + l, for n = 0,1,2,... 

(b) The characteristic polynomial for a n = 4a n _i — 5a n _2 4- 2a n _ 3 is x 3 — 4x 2 4- 5x — 2. We can 
factor this polynomial as 

x 3 — 4x 2 4- 5x — 2 = (x — l) 2 (x — 2). 

Thus we have two roots, x\ = 1 with multiplicity 2, and X 2 = 2. The general formula for 
x n can be written as 

a n = a\ + a 2 n + a 3 2 n . 

Using ao = 0, ai = 2, and a 2 = 5, we obtain 


dn — 2' 1 4~ n — 1. 
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Note that recurrences could be much more complicated than the form given in Equation 14.3, 
and sometimes we may not be able to find simple closed form solutions for them. Nevertheless, 
we can usually use computer programs to compute them for at least moderate values of n. In 
general, if the recursion is not in the form of Equation 14.3, a good start would be to compute 
a n for small n and see if we can identify a pattern and guess a general formula for a n . If we are 
lucky, and we can guess a general formula, then we usually can prove it mathematically using 
induction. 


14.1.2 Using Recursion with Conditioning 


As we have seen so far, conditioning is a powerful method for solving probability problems. In 
some problems, after conditioning we get a recursive relation that can help us solve the problem. 
As an easy example, let’s start with a problem closely related to Example 1. 

Example 3. I toss a fair coin n times and record the sequence of heads and tails. What is the 
probability that I do not observe two consecutive heads in the sequence? 

Solution: Let p„, be the probability of not observing two consecutive heads in n coin tosses. 
One way to solve this problem is to use our answer to Example 1. In that example, we found 
the total number of sequences of length n with no HH to be 

5 + 3\/5/l + \/5\ n , h - {l - VI' 


d n — 


+ 


V 


io V 2 J ' io 

Now, since the total number of sequences of length n is 2 n , and all sequences are equally likely, 
we obtain 

CLr), 


Pn — nr, — 


5 + 3\/5 /1 + \/5 

To V 4 


n 5-3v/5/l—v/5 

To V 4 


(14.7) 


Here we will solve this problem directly using conditioning. Let A n be the event that we 
observe no consecutive heads in n coin tosses, i.e., p n = P(A n ). The idea is to condition on the 
result of the first coin toss. There are two possibilities. Using the law of total probability and 
by conditioning on the result of the first coin toss, we can write 


Pn = P(A n ) = P(A n \H)P(H) + P(A n \T)P(T) 
= l -P{A n \H) + \p{A n \T) 


(14.8) 


Now, to find P(A n \T) note that if the first coin toss is a T, then in order to not observe an HH 
in the entire sequence, we must not observe an HH in the remaining n — 1 coin tosses. Thus, 
we have 


P(A n \T) = P(A n - i) = p n - 1. 

Similarly, if the first coin toss results in an H , the second one must be a T and we must not 
observe an HH in the remaining n — 2 coin tosses, thus we have 

P(A n \H) = * • P{A n - 2 ) = X -p n - 2 . 
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Plugging back into Equation 14.8 we obtain 

1 1 

Pn ~ ^Pn—1 + ~^Pn—2- 

Note that we also know that p\ = 1 and p 2 = |. Using the recursion, we also obtain po = 1. 
Thus we can solve this recursion. We obtain the following characteristic equation 


The characteristic equation has roots x\ = 1+ 4 V ^ and x '2 = 1 4 V ^ , so the general solution is given 
by 


Pn = a 


i + v^ y 


+ p 




Using po = 1 and pi = 1, we obtain 


Pn = 


5 + 3\/5 /1 + \/5 \ n 5 — 3\/5 

10 V 4 y + 10 




Which, as we expect, is the same as Equation 14.7. 


Gambler’s Ruin Problem: 

Here we discuss a famous problem called the Gambler’s Ruin. It refers to a simple gambling 
game in which two gamblers play repeatedly until one of them runs out of money. This is also 
an example of a random walk. 

Example 4. Two gamblers, call them Gambler A and Gambler B, play repeatedly. In each 
round, A wins 1 dollar with probability p or loses 1 dollar with probability q = 1 — p (thus, 
equivalently, in each round B wins 1 dollar with probability q = 1 — p and loses 1 dollar with 
probability p). We assume different rounds are independent. Suppose that initially A has i 
dollars and B has N — i dollars. The game ends when one of the gamblers runs out of money 
(in which case the other gambler will have N dollars). Find p t . the probability that A wins the 
game given that he has initially i dollars. 

Solution: At first it might not be clear that this problem can be solved using recursive 
methods. The main idea is very simple. Condition on the result of the first round. After the 
first round, A will have either i — 1 dollars (if he loses) or will have i + 1 dollars (if he wins). 
This way we can relate p % to pt-\ and pi+i- In particular, applying the law of total probability, 
we obtain 

Pi = P( A wins the game|A wins the first round)P(A wins the first round)+ 

P(A wins the game|A loses the first round)P(A loses the first round) 

= Pi+iP + Pi-\(1 -p). 
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Thus we obtain the recursive equation 


Pi = p i+1 p + Pi-i{l -p). 


We can rewrite the equation as 


PPi +1 = Pi - (1 - p)pi- 1 . 


To solve this recursion we need to know the value of pi for two different values of i. We already 
know that po = 0. If A starts with 0 dollars he is automatically the loser. Similarly, if B starts 
with 0 dollars (i.e., A starts with N dollars), then A is automatically the winner. Thus, we have 
PN = 1. The characteristic equation is 

px 2 — x + (1 — p) = 0 . 


Solving this equation, we obtain two roots, x\ = 1 and x% = ■ The roots are different if 

p / q. Thus, we need to consider two cases: if p / q (i.e., when p / I) we can write the general 
solution as 


Pi = a + f3 



Using po = 0 and pjy = 1, we obtain 


Pi = 


i-(;)"■ 


If P = Q = 2 ’ H ie characteristic equation has a repeated root of x\ = 1 , so the general solution 
can be written as 


Pi = a' + /3'i. 


Using po = 0 and pn = 1, we obtain 


Pi = 


i 

N' 


To summarize, for i = 0,1, 2,..., N, we have 


Pi = 


!-(*)" 
JV if P 


if P / 

1 

2 


1 

2 


Discussion: Using the above answer, we can draw some conclusions. The setup of this prob¬ 
lem in some sense can be a model for someone who goes to the casino and gambles repeatedly. 
We can look at this problem from two points of view. First, let us be somewhat optimistic 
and assume that the casino games are fair. In that case, you can win or lose with probability 
p = q = \ each time. But the casino has usually much more money than an individual gambler, 
that is i « N. This means that your chance of winning, jj is very small. Thus, if you gamble 
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repeatedly you are most likely to lose all your money. What if you are very rich? Assume that 
you have the same amount of money as the casino. Even in that case, you are in no luck. The 
reason is that the games are usually unfair (casino has some advantage), so p < Now, if you 
and the casino both have a large sum of money y then your chance of winning is 


Pi = 


i -r p ) N 
!-<?)* 


since i = 


N 

Y 



since N is large and q > p 


0 as N becomes large. 

Thus, even if you have the same amount of money as the casino, you will most likely lose all 
your money if you gamble repeatedly. 


1 



14.1.3 Solved Problems 

1. Solve the following recursive equations. That is, find a closed form formula for a n . 

(a) a n = a n _i + n, with a q = 0 . 

(b) a n = na n -i, with ao = 1 . 

(c) U '/2 — —i Qct^i — 2 ) with uq — 3, (Zi — 3. 

(d) a n = 3a n _i - 4a n _ 3 , with a 0 = 3, oi = 5, a 2 = 17. 

(e) U /2 — 'l(i[i —i Icifi — 2 i with ctQ — txi — 2. 


Solution: 

(a) Note that this equation is NOT of the form of Equation 14.3, so we cannot use 
our general methodology to solve this problem. In these situations, it is always a 
good idea to compute the first few terms in the sequence and try to guess a general 
formula, and then prove it (possibly using mathematical induction). For this problem 
we quickly observe that 


o-n — lT2 + 3 + -- - + n. 


This is the sum of the numbers from 1 to n, and it is given by a n 


n ( n 2 +1 ) . To obtain 
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this formula, you can write 

a n + a n = ^1 + 2 + 3 + • • • + n 

+ fra + (n - 1) -i-h 2 + 1 

= (1 + n) + (2 + (n - 1 )) 4 -h (n + 1 ) 

= (n + 1 )n. 

(b) Again, this is not in the form of Equation 14.3. By writing the first few a,; ! s we 
observe that 

a n = 1 • 2 • 3 • • • n. 

Thus, we conclude that 

a n = n\ 

(c) This recurrence equation is in the form of Equation 14.3, so we can use our general 
method. In particular, the characteristic polynomial is 

x 2 — 5x + 6. 

This polynomial has two roots, x\ = 2 and X 2 = 3, so the solution will be in the form 

a n = a2 n + /33 n . 

Using ao = 3 and aq = 8 , we obtain 

On = 2 n + 2 • 3 n . 

(d) This recurrence equation is in the form of Equation 14.3, so we can use our general 
method. In particular, the characteristic polynomial is 

x 3 — 3x 2 + 4 = (x — 2) 2 (x + 1). 

Thus, the solution will be in the form 

a n = ot\2 n + cx 2 Ti 2 n + Ck 3 ( — l) rt . 

Using ao = 3, a\ = 5, ci 2 = 17, we obtain 

an = (2 + n)2 n + (—l) n . 

(e) This recurrence equation is in the form of Equation 14.3, so we can use our general 
method. In particular, the characteristic polynomial is 

x 2 — 2x + 2 , 
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which has two complex roots, x\ = 1 + i, X 2 = 1 — i (where i = \f—l). Thus, the 
solution will be in the form 


a n — a(l + i) n + j3{\ — i) n . 
Using ao = a\ = 2, we obtain 


a n = {l+i) n + {l-i) n . 


2. Let a n be the total number of sequences of length n (using H and T) that do not include 
three consecutive Hs. For example, we know that ai = 2 ,d 2 = 4 and as = 7. Find a 
recurrence equation for a n . 

Solution: We can solve this problem with a similar approach to the method we used in 
Example 1. In particular, we will show that 

&n = cin -1 + On—2 + On-3- 

Let’s call these sequences NO-HHH sequences. Consider a NO-HHH sequence of length n. 
This sequence either starts with an T or an H. 

- If it starts with a T, then the rest of the sequence is simply a NO-HHH sequence of 
length n — 1. Conversely, by adding a T in front of any NO-HHH sequence of length 
n — 1, we can obtain a NO-HHH sequence of length n. 

- If it starts with an H, then the second element in the sequence is either an H or a T: 

— If the second element is a T, then the rest of the sequence is simply a NO-HHH 
sequence of length n — 2. Conversely, by adding HT in front of any NO-HHH 
sequence of length n — 2, we can obtain a NO-HHH sequence of length n. 

— If the second element is also an H , then the third element must be a T, and thus 
the rest of the sequence is a NO-HHH sequence of length n — 3. Conversely, by 
adding HHT in front of any NO-HHH sequence of length n — 3, we will obtain 
a NO-HHH sequence of length n. 

Thus, we conclude that a n = a n _i + a n _2 + a n _ 3 . 


3. Let k be a fixed given integer larger than 1. Let /(n, k ) be the total number of sequences 
of length n (using H and T) that do not include k consecutive Hs. Find a recurrence 
equation for f(n,k). 
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Solution: Similar to Example 1 and Problem 2, we can argue that 

f(n, fc) = f(n — 1, k) + f(n — 2, k) + ... + f(n — fc, k), for n > k. 

And /(n, fc) = 2 n for n = 1, 2, 3,..., k — 1, and f(k , fc) = 2 fc — 1. Using the above recursion 
we can define /(0, fc) = 1 so that the above recursion also holds for n = k. 


4. Let /(n, fc, Z) be the number of binary sequences of length n with exactly k ones and at 
least l consecutive zeros. Find a recursive equation along with initial values to compute 
/(n, fc, l ). Assume that n > k + l. 


Solution: Let also g(n , fc, l ) be the number of binary sequences of length n with exactly k 
ones and NO sequences of l consecutive zeros. We have 

f(n,k,l) = (^j — g(n, k, l). 

We provide a recursive formula for /(n, k, l). First note that 

/(n, k, l) = n — l + 1, for k + l = n 
f(n , 0, l ) = 1, for l > 1. 

Now we prove for n > 1, l > 1, k > 0, and fc + l < n we have 

f(n, fc, Z) = f(n - 1, fc - 1, Z) + f(n - 1, fc, Z) + #(n - Z - 1, fc - 1, Z). 

Thus we have the following recursion for /(n, fc, Z): 

/(n, fc, Z) = f{n - 1, fc - 1, Z) + f(n - 1, fc, Z)+ 

( n ^ 1 ) -/(«-z-i,fc-M). 

The above equation can be used to compute /(n, fc, Z) for moderate values of n, fc, and Z. 
Proof: Consider a sequence of length n with exactly fc ones and at least Z consecutive 
zeros. We consider two cases: 


(a) The first n — 1 bits (positions) include at least Z consecutive zeros. In this case the 
last bit is either 0 or a 1 which results in /(n — l,fc — 1, Z) + f(n — 1, fc, Z) distinct 
sequences. 

(b) The first n — 1 bits do NOT include Z consecutive zeros. In this case the last Z bits 
must be zeros and the (n — Z)th bit must be a one. Thus the first n — Z — 1 bits must 
have exactly fc — 1 ones and no consecutive Z zeros. This results in g(n — l — 1, fc — 1, Z) 
distinct sequences. 
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5. I toss a biased coin n times and record the sequence of heads and tails. If P{H) = p 
(where 0 < p < 1), what is the probability that I do not observe two consecutive heads in 
the sequence? 


Solution: Let A n be the event that we observe no consecutive heads in n coin tosses, i.e., 
p n = P(A n ). The idea is to condition on the result of the first coin toss. There are two 
possibilities. Using the law of total probability and by conditioning on the result of the 
first coin toss, we can write 

Pn = P(A n ) = P(A n \H)P(H) + P(A n \T)P(T) 

= p ■ P(A n \H) + (1 - p) • P(A n \T) (14.9) 

Now, to find P(A n \T) note that if the first coin toss is a T, then in order to not observe 
an HH in the entire sequence, we must not observe an HH in the remaining n — 1 coin 
tosses. Thus, we have 

P{A n \T) = -P(Ai-l) =Pn- 1- 

Similarly, if the first coin toss results in an H, the second one must be a T and we must 
not observe an HH in the remaining n — 2 coin tosses, thus we have 

P(A n \H) = (1 - p) • P(A n _ 2 ) = (1 - p)p n _ 2 . 

Plugging back into Equation 14.9 we obtain 

Pn = (1 -p)Pn -1 +p( 1 -p)p n - 2- 

Note that we also know that p\ = 1 and p 2 = 1 — p 2 . Using the recursion, we also obtain 
po = 1. Thus we can solve this recursion. We obtain the following characteristic equation: 

x 2 — (1 — p)x — p( 1 — p) = 0. 

The characteristic equation has roots x± = 1 HUs/t j~ UU+^p) anc j rj .^ _ 1 p p)(!+3p) ^ 
so the general solution is given by 


Pn = a 




Using po = 1 and pi 


1, we obtain 



f3 = 1 — a = 


; (1 - p)(l + 3 p) - 1 —p 
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6. Solve the following recurrence equation, that is find a closed form formula for a n . 

a n = aa n -i + /?, with ao = 1, 
where a/0 and /3 are known constants. 


Solution: This equation is NOT exactly of the form of Equation 14.3 (because of the 
constant /3), so we cannot directly use our general methodology to solve this problem. 
However, by computing a n for a few values of n we can identify the solution: 


In general, we obtain 


ai = a + (3 

02 — ol* T (4{1 T o) 

03 = T /4(1 T ex T a 2 ) 

&3 = T (4{1 + a + o? T o^). 


a n = a n + /?( 1 + a + a 2 + • + a n x ) 
' l - a r ‘ 

= a n + f3 ' 


1 — a 


7. This problem has applications in coding theory: I toss a biased coin n times and record 
the sequence of heads and tails. If P(H) = p (where 0 < p < 1), what is the probability 
that I observe an even number of H s? 


Solution: Let A n be the event that I observe an even number of heads for n = 1,2,.... Let 
a n = P{A n ). Conditioning on the last coin toss, we can write for n > 2: 

an = P(A n \H)P(H) + P(A n \T)P(T) 

= p ■ P(A n \H) + (1 - p) • P{A n \T) 

= p-P{A c n _ l ) + (l-p)-P(A n _ l ) 

= p( 1 - On- 1 ) + (1 -p)a n -i. 

Thus, we obtain the following recursive equation: 


On = (1 - 2 p)a n -i +p, 


with a\ = 1 — p. 
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From the recursion, we obtain ao = 1, so we have the following equation: 

a n = (1 — 2 p)a n -i +p, with a 0 = 1. 

This recursion is in the form given in problem 6 (a = 1 — 2p, (3 = p), so we obtain 

'1 - (1 - 2 p) r 


a n = (1 - 2 p) n +p 

1 + (1 - 2 p) n 


2 p 


14.2 End of Chapter Problems 


1. Solve the following recurrence equations, that is, find a closed form formula for a n . 

(a) a n = 2a n -i - §a n _ 2 , with ao = 0, ai = — 1. 

(b) a n = 4a n _i — 4a n _2, with ao = 2, ai = 6. 

2. I toss a biased coin n times. Let P{H) = p and let a n ^ be the probability that I observe 
k heads. 


(a) By conditioning, on the last coin toss, show that a n+ i,fc+i = p ■ a ny k + (1 — p) ■ a n< k+ 1 - 

(b) Using part (a), prove that for 0 < k < n, we have (^{) = (fc+i) + (^)- 

3. * You toss a biased coin repeatedly. If P(H) = p, what is the probability that two 
consecutive H s are observed before we observe two consecutive Ts? For example, this 
event happens if the observed sequence is THT HH THTT 

4. I toss a biased coin n times and record the sequence of heads and tails. Assume P(H) = p 
(where 0 < p < 1). Let a n be the probability that the number of heads is divisible by 3. 
Write a set of recursive equations to compute a n . 



